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DETAILED ACTION 
Claim Rejections - 35 USC § 102 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless -- 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United 
States only if the international application designated the United States and was published under 
Article 21 (2) of such treaty in the English language. 

2. Claims 1-4, 19-23, 25-26 are rejected under 35 U.S.C. 102(e) as being by 
Vaithilingam et al, US 6,411,724 (hereinafter, patent 724). 

Re claim 1, patent 724 discloses the same computer-readable medium 
comprising software for a video surveillance system, comprising code segments for 
operating the video surveillance system based on video primitives. (Figs. 2 &4, col. 1, 
lines 24-27, col. 2, line 65 - col. 3, line 3, col. 3, line 44 - col. 5, line 21 , these segments 
discuss software algorithm for multimedia information retrieval or query for various 
applications, including surveillance, based on video primitives i.e. meta-descriptors. 
Note: software implies a computer-readable medium). 

Re claim 2, a computer-readable medium as in claim 1 , wherein the code 
segments for operating the video surveillance system comprises: code segments for 
extracting video primitives (col. 5, lines 1-21); and code segments for extracting event 
occurrences from the video primitives (col. 11, line 14 - col. 12, line 14, these segments 
discuss "event" occurrences from description schemes). 
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Re claim 3, a computer-readable medium as in claim 2, wherein the event 
occurrences are extracted using event discriminators (col. 1 1 , line 14 - col. 12, line 14, 
these segments discuss "event" occurrences from description schemes, which are 
ultimately extracted for analysis). 

Re claim 4, a computer-readable medium as in claim 2, further comprising code 
segments for archiving the extracted video primitives (col. 3, line 44 — col. 4, line 29, 
these segments discuss extracted descriptors which are then "archived" in multimedia 
repository). 

Re claim 19, a computer-readable medium as in claim 1 , wherein the video 
primitives are from at least one of a video sensor and another sensor. (See col. 1 , lines 
65-66). 

Re claim 20, a computer-readable medium as in claim 1 , wherein the video 
primitives are retrieved from an archive of video primitives. (See col. 2, lines 50-64). 

Re claim 21 , a computer system comprising the computer-readable medium of 
claim 1 . (See fig. 1 , col. 1 3, line 65 - col. 14, line 7). 

Re claims 22-23, 25-26, the limitations have been analyzed and rejected w/r to 

- claims 1-4 and 19-20. - -- ' 

Claim Rejections - 35 USC § 103 
3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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4. Claims 5-18, 24 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Vaithilingam et al, US 6,411,724 (hereinafter, patent 724) as applied to claims 
1-2, 22 above and further in view of Collins et al, "A System for Video Surveillance 
and Monitoring". 

Re claim 5, patent 724 discloses a computer-readable medium comprising 
software for a video surveillance application, but fails to provide details for undertaking a 
response based on extracted event occurrences as claimed. Collins et al makes it well 
known a computer implemented video surveillance system comprising code segments 
for undertaking a response based on extracted event occurrences. (For example, see 
fig. 4, para. 2.2-2.3, 3.2, 3.6.1. In these segments, object movements qualify as event 
occurrences, and tracking said object movements qualify as a response). 

Therefore, taking the combined teaching of patent 724 and Collins et al as a 
whole, it would have been obvious to modify video surveillance as suggested in patent 
724 to include object tracking in response to object movements as taught by Collins et 
al for the benefit of targeted video surveillance. 

Re claim 6, a computer-readable medium as in claim 5, wherein the response 
comprises initiating another sensor system. (See Collins et al, fig. 4, para. 3.6.2-3.6.3, 
these segments discuss switching or sensor hand-off during object tracking). 

Re claim 7, patent 724 discloses a computer-readable medium comprising 
software for a video surveillance application, but fails to provide details for calibrating 
the video surveillance system as claimed. Collins et al makes it well known a computer 
implemented video surveillance system comprising code segments for calibrating the 
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video surveillance system. (For example, see Collins et al, para. 4 & 4.2, these 
segments discuss about calibrating the video surveillance system). 

Therefore, taking the combined teaching of patent 724 and Collins et al as 
a whole, it would have been obvious to modify video surveillance as suggested in patent 
724 to include camera calibration as taught by Collins et al for the benefit of minimizing 
human intervention. 

Re claim 8, a computer-readable medium as in claim 7, wherein the code 
segments for calibrating comprise code segments for self-calibrating the video 
surveillance system. (See Collins et al, para. 4.2, this segment discusses about self 
calibrating the video surveillance system). 

Re claim 9, a computer-readable medium as in claim 8, wherein the code 
segments for self-calibrating comprise: code segments for detecting at least one object 
in a source video; and code segments for tracking the object. (See Collins et al, para. 
3.1 , 3.1 .1 , 3.1 .2, 3.1 .3, 3.2, 4 & 4.2, these segments discuss about self-calibrating the 
video surveillance system involving detecting at least one object in a source video, and 
tracking said object). 

— —Re claim-I O^-a computer-readable medium as in claim 9^wherein the code — 

segments for detecting at least one object comprise: code segments for detecting at 
least one object via motion of the object; and code segments for detecting at least one 
object via change in a background model. (See Collins et al, para. 3.1, 3.1.1, 3.1.2, 
3.1 .3, 3.2, these segments discuss about detecting object in motion and detecting 
object via change in a background model). 
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Re claim 1 1 , a computer-readable medium as in claim 7, wherein the code 
segments for self-calibrating comprise: code segments for identifying trackable areas, 
and code segments for identifying typical sizes of typical objects. (See Collins et al, 
para. 3.1, 3.1.1, 3.1.2, 3.1.3, 3.2, these segments also discuss about identifying 
trackable areas, and identifying typical sizes of typical objects). 

Re claim 12, a computer-readable medium as in claim 7, wherein the code 
segments for calibrating comprise: code segments for manual calibration; code 
segments for semi-automatic calibration; and code segments for automatic calibration. 
See Collins et al, para. 4.2, this segment discusses provision enabling manual, semi- 
automatic, and automatic calibration). 

Re claim 13, patent 724 discloses a computer-readable medium comprising 
software for a video surveillance application, but fails to provide details for tasking the 
video surveillance system with event discriminators as claimed. Collins et al makes it 
well known a computer implemented video surveillance system comprising code 
segments for tasking the video surveillance system with event discriminators. (For 
example, see Collins et al, para. 3.6.3, 5, 5.1, 5.2, these segments discuss tasking the 

video surveillance system with event discriminators. See also Table -3-6)— — - 

Therefore, taking the combined teaching of patent 724 and Collins et al as 
a whole, it would have been obvious to modify video surveillance as suggested in patent 
724 to include tasking the video surveillance system with event discriminators as taught 
by Collins et al for the benefit of enhanced video surveillance in complex scenes. 



Application/Control Number: 09/987,707 Page 7 

Art Unit: 2613 

Re claim 13, a computer-readable medium as in claim 1 , further comprising code 
segments for tasking the video surveillance system with event discriminators. (See 
Collins et al, para. 3.6.3, 5, 5.1 , 5.2, these segments discuss tasking the video 
surveillance system with event discriminators. See also Table 3-6). 

Re claim 14, a computer-readable medium as in claim 13, wherein the code 
segments for tasking comprise code segments for identifying at least one object. (See 
Collins et al, para. 5, 5.1, 5.2, these segments discuss tasking that comprises identifying 
at least one object. See also Table 3-6 ). 

Re claim 15, a computer-readable medium as in claim 13, wherein the code 
segments for tasking comprise code segments for identifying at least one spatial area. 
(See Collins et al, para. 5, 5.1, 5.2, these segments also discuss tasking that comprises 
identifying at least one spatial area. See also Table 3-6). 

Re claim 16, a computer-readable medium as in claim 13, wherein the code 
segments for tasking comprise code segments for identifying at least one temporal 
attribute. (See Collins et al, para. 5, 5.1, 5.2, these segments also discuss tasking that 
comprises identifying at least one temporal attribute. See also Table 3-6). 

— Re -Glaim-1-7— a computer-readable medium as in claim 13, wherein the code- 

segments for tasking identify at least one interaction. (See Collins et al, para. 5, 5.1, 
5.2, these segments also discuss tasking that comprises identifying at least one 
interaction. See also Table 3-6). 
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Re claim 18, a computer-readable medium as in claim 13, wherein the code 
segments for tasking identify at least one alarm. (See Collins et al, para. 3.2, this 
segment discusses identifying and rejecting false alarms). 

Re claim 24, a computer-readable medium as in claim 22, further comprising 
code segments for undertaking a response based on extracted event occurrences. 
(The limitations have been analyzed and rejected w/rto claim 5). 

Contact 

5. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Vu Le whose telephone number is 703-308-6613. The 
examiner can normally be reached on M-F 8:30-6:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Chris Kelley can be reached on 703-305-4856. The fax phone number for 
the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished-applications isavail^ 

For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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